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Background: Surgical mortality results are increasingly being reported and published in the public 
domain as indicators of surgical quality. This study examined how mortality outlier status at 90 days 
after colorectal surgery compares with mortality at 30 days and subsequent intervals in the first year 
after surgery. 

Methods: All adults undergoing elective and emergency colorectal resection between April 2001 and 
February 2007 in English National Health Service (NHS) Trusts were identified from administrative 
data. Funnel plots of postoperative case mix-adjusted institutional mortality rate against caseload were 
created for 30, 90, 180 and 365 days. High- or low-mortality unit status of individual Trusts was defined 
as breaching upper or lower third standard deviation confidence limits on the funnel plot for 90-day 
mortality. 

Results: A total of 171 688 patients from 153 NHS Trusts were included. Some 14 537 (8-5 per cent) 
died within 30 days of surgery, 19 466 (11-3 per cent) within 90 days, 23 942 (13 -9 per cent) within 180 
days and 3 1 782 (18-5 per cent) within 365 days. Eight institutions were identified as high-mortahty units, 
including all four units with high outlying status at 30 days. Twelve units were low-mortality units, of 
which six were also low outliers at 30 days. Ninety-day mortality correlated strongly with later mortality 
results (r s = 0 957, P < 0 001 versus 180-day mortality; r s = 0 860, P < 0 001 verms 365-day mortality). 
Conclusion: Extending mortality reporting to 90 days identifies a greater number of mortality outliers 
when compared with the 30-day death rate. Ninety-day mortality is proposed as the preferred indicator 
of perioperative outcome for local analysis and public reporting. 
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Introduction 

Colorectal surgery is commonly performed for benign and 
malignant disease, and carries a significant risk of death 
or complication 1 ~ 3 . Colorectal cancer is the third most 
common cancer diagnosed in the UK 4 and surgery is 
the main treatment. Outcomes, such as mortality and 
morbidity rates, are often used as indicators of care 
quality. 

Perhaps the earliest public use of outcome data began in 
America in the 1980s 5 . Measures of system performance, 
such as waiting times for surgery, are currently published 
in a number of other countries 6-8 . Publication of more 
specific outcomes is an area of ongoing development 
internationally, for example in the National Health 
Service (NHS) in England 9 . It is therefore important to 



explore how different mortality measures may affect the 
identification of units with high or low death rates. 

Thirty-day mortality has conventionally been used to 
reflect perioperative outcome. Published 30-day and 1-year 
mortality rates after colorectal surgery range from 3 -0 to 4-9 
per cent, and from 8-8 to 12-4 per cent, respectively 10-12 . 
High mortality beyond 3 0 days highlights the importance 
of considering alternative periods for mortality reporting. 

It is not known whether lengthening follow-up for 
analysis of postoperative deaths from 30 to 90 days results 
in the identification of a different group of units with 
outlying results. Neither has the relationship between high 
or low mortality rates at 90 days and death rates at 180 
and 365 days been studied in the literature. It is also 
important to examine metrics in different contexts, mindful 
of changes in practice over time. This study examined the 
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relationship between mortality metrics during the first year 
after colorectal surgery, using national, routinely collected, 
data for England between 2001 and 2007. 

Methods 

Ethical approval for the study was obtained from the local 
research ethics committee. 

Data sources 

English NHS hospitals mandatorily submit data for 
all inpatient activity to the Hospital Episode Statistics 
(HES) database. This includes International Classification 
of Diseases, tenth revision (ICD-10) 13 diagnosis codes 
and Office of Population Censuses and Surveys Clas- 
sification of Interventions and Procedures, version 4.4 
(OPCS-4) 14 procedure codes with associated dates. The 
NHS Information Centre links HES and statutory records 
of death to establish whether a patient died after surgery. 
From this database, patients aged 18 years or more 
undergoing colorectal resection between 1 April 2001 and 
28 February 2007 were selected for inclusion and grouped 
according to OPCS codes for colonic or rectal resection 
(Table 1). 

Data processing 

Using anonymized patient identifiers, the data were 
processed to eliminate duplications of records and to 
identify the first major resection (when a patient under- 
went more than one major procedure). Trusts performing 
surgery on a selected population (for example, children 
or women only) or fewer than ten times during the 



Table 1 Procedures included in each group for regression 
modelling 



Procedure group 


Procedures included, with OPCS-4 codes 


Subtotal/total colectomy 


Subtotal colectomy (H29) 




Total colectomy (H05) 




Panproctocolectomy (H04) 


Right colectomy 


Right hemicolectomy (H07) 




Extended right hemicolectomy (H06) 




Transverse colectomy (H08) 


Left colectomy 


Left hemicolectomy (H09) 




Sigmoid colectomy (H10) 


Rectal resection 


Anterior resection (H33-2-33-4, H33-6, 




H33-8-33-9) 




Abdominoperineal resection (H33-1) 




Hartmann's procedure (H33-5) 



OPCS-4, Office of Population Censuses and Surveys Classification of 
Interventions and Procedures, version 4-4. 
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study period were excluded from analysis. This included 
cardiothoracic, orthopaedic, paediatric, women's health, 
and reconstructive and rehabilitative NHS Trusts. 

For risk adjustment a number of patient-, condition- and 
procedure -related variables were derived. Age was coded 
into four groups: less than 55 years, 55-69 years, 70-79 
years, and 80 years or above. Charlson co-morbidity index 
scores were derived from secondary ICD-10 diagnosis 
codes and grouped as follows: 0, 1-2, 3-5 and 6 or 
above. The primary colorectal diagnosis was classified as 
malignant or benign. Admissions were coded as elective or 
non-elective. Operative procedures were grouped as shown 
in Table 1 . Use of laparoscopy was derived from OPCS-4 
codes Y058, Y752 and Y714. Year of procedure was coded 
as a categorical variable to facilitate adjustment for any 
improvement in results over time. All-cause mortality was 
coded as a binary variable at various time points: 30, 90, 
180 and 365 days. 

Statistical analysis 

Analyses were undertaken using SPSS® version 20.0 (IBM, 
Armonk, New York, USA). Cohort characteristics were 
assessed for similarity using the x. 2 test for all categorical 
variables. Variables with P < 0-100 on univariable analysis 
were included in the risk adjustment model. Case mix 
adjustment was performed using binary logistic regression 
for each mortality period with the following categorical 
co-variables, provided they met inclusion criteria: age 
group, sex, Charlson co-morbidity index group, admission 
type, diagnosis, procedure type, surgical approach (open or 
laparoscopic) and year of procedure. Observed mortality 
and predicted probabilities of death were aggregated by 
provider to calculate observed and expected mortality 
rates for the entire study period. The observed-to- 
expected (O/E) mortality ratio was multiplied by the 
national mortality rate and each unit's caseload to obtain 
a Trust-level risk-adjusted mortality for the entire study 
period. Model fit was assessed using the receiver operating 
characteristic (ROC) function. 

Funnel plots of risk-adjusted mortality rate against 
caseload were generated for each postoperative time period 
using the online tool provided by the Public Health 
Observatories' Analytical Tools for Public Health: Funnel 
plot for proportions and percentages (http://www.apho. 
org.uk/resource/view.aspx? RID=3 9403). Pseudonymized 
providers were identified across the funnel plots to assess 
for changes in position relative to 99-7 and 95 per cent 
control limits. Provider-level O/E mortality ratios across 
the time periods were tested for non-parametric correlation 
using Spearman's rank correlation coefficient. 
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Fig. 1 Funnel plot of risk-adjusted postoperative mortality against 
total caseload by Trust from 0 to 30 days (90-day mortality 
outliers marked). HMU, high-mortality unit; LMU, 
low-mortality unit 
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Fig. 2 Funnel plot of risk-adjusted postoperative mortality against 
total caseload by National Health Service (NHS) Trust from 0 to 
90 days (90-day mortality outliers marked). HMU, high- 
mortality unit; LMU, low-mortality unit 

Results 

Cohort characteristics 

A total of 171 688 patients underwent a primary colorectal 
resection in 153 NHS Trusts that met the inclusion and 
exclusion criteria. Some 112 557 operations (65-6 per cent) 



were performed on an elective basis, 107 780 (62-8 per cent) 
for malignant disease. In all, 5566 procedures (3-2 per cent) 
were performed laparoscopically. A comprehensive 
cohort summary is presented in Table SI (supporting 
information). 

Mortality rates 

Of the 171 688 patients, 14 537 (8-5 per cent) died within 
30 days of surgery. At 90 days, 19 466 (11-3 per cent) had 
died, increasing to 23 942 (13-9 per cent) and 31 782 (18-5 
per cent) at 180 and 365 days respectively. 

Factors associated with mortality 

On univariable analysis, all co-variables were correlated 
significantly with mortality (data not shown). Multivari- 
able logistic regression results for each postoperative time 
period are shown in Table S2 (supporting information). 
Across periods, increased mortality was associated sig- 
nificantly with increasing age, increasing co-morbidity 
score, non-elective surgery and benign diagnosis. Reduced 
mortality was significantly associated with female sex, 
operations other than total/subtotal colectomy, laparo- 
scopic surgery and later year of operation. The mod- 
els yielded satisfactory measures of fit (c-statistic range 
0-758-0-809). 
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Fig. 3 Funnel plot of risk-adjusted postoperative mortality against 
total caseload by National Health Service (NHS) Trust from 0 to 
180 days (90-day mortality outliers marked). HMU, 
high-mortality unit; LMU, low-mortality unit 
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Table 2 Total number of Trusts identified as outliers for 
mortality according to varying definitions of outlier status 



Total no. of operations 



Fig. 4 Funnel plot of risk-adjusted postoperative mortality against 
total caseload by National Health Service (NHS) Trust from 0 to 
365 days (90-day mortality outliers marked). HMU, high- 
mortality unit; LMU, low-mortality unit 

Relationship between mortality time periods 

A Trust was considered an outlier for mortality if its risk- 
adjusted death rate was more than three standard deviations 
(s.d.) from the mean. Trusts could be outliers for mortality 
at any of the postoperative time points analysed. High- 
or low-mortality unit (HMU/LMU) status was defined 
specifically as any Trust with high or low outlying mortality 
at 90 days. Figs 1-4 show funnel plots of mortality against 
caseload for each postoperative time period. 

At 30 days, four Trusts were high-mortality outliers; 
all of these were HMUs. Of the remaining four HMUs, 
three were close to the upper 95 per cent control limit 
(2 above, 1 below) and one unit was within control limits, 
just below average for mortality (Fig. 1). Of the 12 LMUs, 
six were low-mortality outliers for 3 0-day mortality. Of the 
remaining six LMUs, all had mortality rates below the 95 
per cent control limit at 30 days. Two further Trusts were 
low-mortality outliers at 30 days but were not identified as 
LMUs. 

At 180 and 365 days, increased variation in mortality 
was seen, with increasing numbers of outliers beyond the 
95 and 99-7 per cent control limits (Table 2). At 180 days, 
all HMUs were above the third s.d. control limits, with 
no new outliers identified (Fig. 3). Eleven LMUs were 
low-mortality outliers at 180 days. The 12th LMU had 
below-average mortality, within two s.d. of the national 
mean. A further four units not identified as LMUs had low 
outlying mortality at 180 days. At 365 days, seven of eight 
HMUs had high outlying mortality, whereas mortality for 







Follow-up period (days) 






0-30 


0-90 


0-180 


0-365 


Outside 3 s.d. 


12 


20 


23 


25 


HMU 


4 


8 


8 


10 


LMU 


8 


12 


15 


15 


Outside 2 s.d. 


49 


54 


50 


55 


HMU 


21 


27 


23 


22 


LMU 


28 


27 


27 


33 



Outlier definition was varied by follow-up period and by number of 
standard deviations (s.d.) from mean mortality. HMU, high-mortality 
unit; LMU, low-mortality unit. 

Table 3 Spearman's correlation coefficient between 
observed-to-expected mortality ratios across varying follow-up 
periods for all Trusts 



Mortality period 
for comparison 


0-90 days 


0-180 days 


0-365 days 


r s P* 


r s P* 


r s P* 


0-30 days 


0-924 < 0-001 


0-853 < 0-001 


0-735 < 0 001 


0-90 days 




0-957 < 0 001 


0-860 < 0-001 


0-180 days 






0-933 < 0-001 



*Two-tailed t test. 

the eighth HMU was between 95 and 99-7 per cent control 
limits (Fig. 4). Eight of 12 LMUs had mortality rates below 
the 99-7 per cent control limits. Of the remaining four 
LMUs, three were more the two s.d. below the mean for 
mortality, and one was within 95 per cent control limits. 

There was good correlation for mortality rates across 
time periods calculated for all 153 Trusts (Table 3). The 
strongest overall correlation with other follow-up periods 
was observed for 0-90-day and 0-180-day O/E mortality 
ratios. 

Discussion 

These results confirm previous findings 10 ~ 12 of a significant 
burden of mortality beyond 30 days after surgery. Twice 
the number of high outlying units was identified at 90 days 
compared with 30 days, including all 30-day high outliers. 
High outlying mortality at 90 days was associated with 
high mortality rates at 180 and 365 days after surgery. Low 
outlying mortality at 90 days was also robust across time 
periods. 

The findings of this study must be considered in the 
light of its limitations. Potential problems with the quality 
of administrative data and their use for non-administrative 
purposes have been considered previously 13 , although their 
validity for clinical research has been demonstrated 16 ' 17 . 
Furthermore, alternatives such as voluntary data are not 
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problem-free 18-20 . Stage of disease was not available for 
inclusion in multivariable models for patients with cancer. 
However, although stage may strongly influence later 
survival, it may be argued that death directly due to 
cancer within 90 days of resectional surgery could be 
considered a failure of surgical care. Although elective and 
non-elective patients may represent different populations, 
the regression model adjusted for this, as performed 
in other studies of postoperative outcome 21-23 . Other 
unmeasured confounding variables may have influenced 
mortality rates. The study examined all-cause mortality. 
Follow-up over longer periods may result in inclusion 
of increasing numbers of deaths from unrelated factors. 
There have been changes in routine colorectal practice 
since 2007, such as increased use of laparoscopy 24 ' 25 , and 
the recommendation and implementation of enhanced 
recovery programmes 26 ' 27 . Some 28-31 have shown no 
association between these changes and death rates, whereas 
others 10 ' 32 have shown an association between laparoscopy 
and reduced mortality. To influence the differences 
between 30- and 90-day mortality, these changes would 
need to have a differential effect on death between these 
two time periods. Although this seems unlikely, the authors 
intend to repeat the current analysis on a contemporary 
data set. 

The mortality rates presented are high, with wide 
variation and a steady reduction over time. Non-elective 
colorectal surgery is associated with a high death rate 1 ' 12 ' 33 . 
The relatively large proportion of non-elective surgery in 
this cohort significantly influenced the average mortality 
rates, differentiating this study from others reporting 
30-day and 1-year mortality 10-12 . Wide variation has 
been documented for a number of colorectal outcome 
measures in other publications 21-23 ' 34 and has not yet been 
explained adequately. Falling postoperative mortality has 
been observed after colorectal cancer surgery 21 , as well 
as other malignant and benign operative procedures 3 ' 36 . 
However, other research suggests that this may not 
apply to all colorectal surgery, such as non-elective 37 or 
inflammatory bowel 38 procedures. Trends in mortality 
over time should be studied further. 

A greater number of mortality outliers were identified 
90 days after surgery than at 30 days. The underlying 
reasons for this are not clear. As 90-day mortality captures 
more deaths than in-hospital mortality 39 , postdischarge 
deaths, with or without readmission, must contribute to 
this outcome. This does not, however, explain changes in 
relative performance. Some authors 40 ' 41 have described 
problems relating outcomes to quality of care, but 
others 42-41 have demonstrated an association between 
the two. The authors suggest that development of HMU 
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status after 30 postoperative days may relate to a number 
of factors: unmeasured case mix variables, complication 
management and follow-up practices. Unmeasured factors, 
such as socioeconomic status, may influence outcome. 
Complications, such as deep vein thrombosis, may present 
after 30 days 46 . Certainly, a significant number of 
readmissions after colorectal surgery may occur after this 
interval 47 . Severe complications that present late may be 
captured only when the definition of death is extended 
to 90 days. Intensive postdischarge follow-up with ready 
access to specialist care may affect outcome. Variation in 
'failure-to-rescue' rates (the proportion of patients dying 
after diagnosis of a complication) may represent differences 
in the effectiveness of complication management within a 
unit 22 . Ninety-day mortality may provide some reflection 
of the ability of a hospital to manage complications. 
This metric may therefore be influenced by factors 
outside the direct influence of the responsible consultant, 
such as the provision of critical care and radiology 
services. 

One unit had below-average mortality at 30 days, but 
became a high outlier by the 90th postoperative day. 
Unadjusted mortality for this unit was initially low (2-3 
per cent at 30 days), rising to within 0-5 per cent of the 
national mean at 3 65 days. The patient cohort was younger 
with less co-morbidity and more women, compared with 
the national cohort. There were also relatively more 
elective and malignant procedures. The risk adjustment 
process would calculate a lower-than-average expected 
mortality for such patients, resulting in this unit's 
HMU status. 

Previous publications examining the relationship 
between mortality rates across different time periods for 
non-colorectal specialties have shown good correlation 
when follow-up is cumulative 48 ' 49 . One colorectal paper 11 
assessed the correlation of mortality results between non- 
overlapping time periods (0-30 days, 30 days to 1 year, 
and 1-5 years) and found good correlation, suggesting 
that this represented consistent quality of care throughout 
follow-up. 

Although low outlying mortality may be esteemed, it is 
unlikely to have the same implications as high outlying 
mortality. With public outcome reporting, it is likely that 
units with high mortality will be subject to increasing 
scrutiny by commissioners, regulators, the media and 
patients. High outlying mortality should not be used 
objectively to judge the quality of a unit. It may be 
considered an indicator of a possible problem with quality 
of perioperative care that needs further examination. 
This may involve a multimodal and multidisciplinary 
approach, including site visits, as adopted by the Keogh 

www.bjs.co.uk British Journal of Surgery 2013; 100: 1810-1817 



Postoperative mortality rates at 30 and 90 days 



1815 



report 10 . Future study of specific causes of death may help 
further to explain differences in mortality results. Although 
high-mortality Trusts may receive the greatest attention, 
study of both high- and low-mortality units is needed to 
understand better how to minimize the risk of death after 
surgery. 

The findings of the present study may have implications 
for outcomes assessment across the surgical specialties. 
Although the number of additional deaths observed beyond 
30 days may vary by specialty, longer follow-up may allow 
better reflection of the outcomes of complications after 
other types of surgery. The findings of this study should 
apply across healthcare systems, as the timing of death 
relates primarily to the nature of the disease and patient 
response to treatment. 

Adoption of 90-day postoperative mortality for reporting 
institutional outcomes in colorectal surgery identified 
a greater number of outliers than 30-day mortality. It 
successfully identified all units with high mortality at 30 
days, while identifying additional HMUs. The authors 
suggest that this measure may provide a better reflection 
of perioperative outcome by allowing more time for the 
effects of surgical care to become manifest. 
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